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CHAPTER  1 


INTRODUCTION 

Overview 

The  process  of  management  Involves  planning,  organ¬ 
izing,  assembling  resources,  motivating,  and  controlling. 

The  controlling  process  was  the  central  theme  of  this 
research.  The  word  "control"  has  several  meanings  and  con¬ 
notations.  According  to  Fremont  E.  East  and  James  E.  Rosen- 
zweig,  noted  management  authors,  control  can  meant 

1.  to  check  or  verify, 

2 .  to  regulate , 

3.  to  compare  with  a  standard, 

4.  to  exercise  authority  over  (direct  or  com¬ 
mand)  ,  or 

5.  to  curb  or  restrain  £4i466J, 

This  study  was  concerned  with  control  in  relation  to  insur¬ 
ing  that  the  quality  of  maintenance  performed  was  according 
to  predetermined  plans  and  standards. 

Generally,  every  type  of  maintenance  organization 
has  some  form  of  control  process.  Since  control  is  a  basic 
process  used  by  management  and  maintenance  of  equipment  is 
a  requirement,  it  would  be  redundant  to  expound  upon  the 
need  for  quality  maintenance  or  that  it  must  be  controlled 
in  some  manner.  What  has  to  be  emphasized  is  that  the 
quality  control  program  used  by  management  must  be  efficient 
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and  effective.  This  research  Investigated  the  effective¬ 
ness  and  efficiency  of  the  Air  Force’s  Strategic  Air  Com¬ 
mand's  (SAC)  methods  for  controlling  the  quality  of  Minute- 
man  Intercontinental  Ballistic  Missile  (ICBM)  maintenance. 


Air 


>rce  Maintenance  Standardization 
Evaluation  Program  (MSEP) 


The  Air  Force  has  developed  general  quality  control 
measures  and  policies  for  major  commands  (MAJCOMS)  to  use 
In  establishing  their  respective  maintenance  quality  control 
programs.  The  Intent  of  the  Air  Force  quality  assurance 
program  Is  established  In  Air  Force  Manual  (AFM)  66-1, 

Volume  I  where  It  states i 


Maintenance,  as  a  functional  element  of  the  organi¬ 
zation  Is  responsible  for  Lnsurlng  that  Air  Force  mate¬ 
rial  Is  serviceable,  safely  operable,  and  properly 
configured  to  meet  the  minimum  requirements  Ll4il-l]. 

The  pivotal  point  of  the  Air  Force's  quality  assur¬ 
ance  program  Is  the  MSEP.  MSEP  Is  defined  In  AFM  66-1, 
Volume  I  as i 


A  quantitative  quality  control  program  designed  to 
check  individual  technical  competence  and  the  quality 

?f  maintenance  through  evaluations  and  Inspections 
14iA2-2J. 

AFM  66-1,  Volume  I  also  states  the  overall  objective  of  the 
MSEP.  This  1st 


...  to  Improve  technician  competence  and  mainte¬ 
nance  quality.  This  objective  Is  realized  by  training 
the  technician  to  use  standard  maintenance  practices, 
strictly  complying  with  accurate  technical  data,  and 
periodically  evaluating  personnel  and  hardware  with 
highly  qualified  technicians  [l4»l-2]. 
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SAC  MSEP 

MAJCOMS  have  developed  supplemental  directives  on 
MSEP  for  use  at  local  levels.  The  major  portion  of  SAC*s 
guidance  for  quality  control  for  local  managers  is  contained 
in  SAC  Regulation  (SACR)  66-1 l.  In  conjunction  with  this, 
SACR  66-6,  Volume  £  provides  specific  SAC  policies  and  pro¬ 
cedures  for  the  ICBM  MSEP.  The  ICBM  MSEP  is  SAC's  focal 
point  for  insuring  that  satisfactory  maintenance  is  performed 
on  Minuteman  missiles.  ICBM  MSEP's  primary  emphasis  is  on 
the  evaluation  of  a  technician  while  performing  maintenance. 
It  attempts  to  insure  a  high  standard  of  quality  maintenance 
".  .  .  through  technician  competence,  accurate  and  efficient 
technical  procedures,  and  strict  compliance  with  technical 
publications  and  maintenance  directives  £l2il-l].”  The 
development  of  ICBM  MSEP  stems  from  the  fact  that  ”...  dis¬ 
persed  work  locations  limit  the  supervisor's  capability  to 
monitor  a  large  part  of  the  maintenance  in  progress 
Cl2i4-l].”  For  example,  the  150  Minuteman  ICBMs  of  the 
321  Strategic  Missile  Wing  (SMW),  Grand  Forks  Air  Force  Base 
(GFAFB),  North  Dakota  are  dispersed  throughout  an  area 
approximately  110  miles  long  by  60  miles  wide. 

Background 

A  Minuteman  Missile  Wing  has  either  150,  200,  or 
250  missiles.  Each  50  missiles  constitutes  a  squadron  which 
in  turn  contains  5  flights  of  10  missiles  each.  A  Launch 
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Control  Facility  (LCF),  managed  by  a  launch  crew,  controls 
each  flight.  The  flight's  missiles  are  dispersed  a  number 
of  miles  from  the  LCF  in  Launch  Facilities  (LF). 

Launch  crews  continuously  monitor  each  LF  maintenance 
status  via  computer  printouts  and  display  boards  located  in 
the  LCF.  The  status  is  determined  by  an  interrogation  proc- 
ess  between  the  LCF  Weapon  System  Controller  and  the  Missile 
Digital  Control  Unit  (MDCU).1  Should  a  maintenance  fault 
occur  anywhere  within  a  critical  missile  component  or  sup¬ 
porting  electronic  apparatus  at  the  LF,  the  launch  crew  is 
notified  by  a  Maintenance  Status  Reply  from  the  MDCU.  Other 
ways  that  faults  are  discovered  occur  as  a  result  of  routine, 
periodic  maintenance  visits  or  supervisory  visits  to  a  LF. 

When  faults  are  discovered,  the  response  is  normally 
to  notify  missile  maintenance  Job  Control  (JC)  with  the 
Information.  JC  then  logs  the  information  and  updates  the 
Maintenance  Management  Information  and  Control  System. 
Maintenance  teams  are  dispatched  from  the  support  base  to 
the  LF  to  remedy  faults.  The  more  critical  the  fault  the 
more  quickly  JC  dispatches  a  maintenance  team  (l3s3-7). 

*Both  the  Weapon  System  Controller  and  the  Digital 
Control  Unit  are  electronic  computers.  The  Weapon  System 
Controller  monitors  missile  site  activity  for  an  entire 
squadron  while  the  Digital  Control  Unit  monitors  the  status 
of  its  own  missile  and  also  acts  as  the  guidance  system  for 
the  missile. 
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Many  activities  within  a  Minuteman  Wing  must  be 
coordinated  to  get  a  maintenance  team  to  the  LF  or  LCF . 
Because  the  LFs  and  LCFs  are  located  far  from  base,  the 
maintenance  team  must  take  everything  with  it  that  it  will 
need  for  the  job.  Accordingly,  all  appropriate  equipment 
and  transportation  must  be  scheduled.  The  security  police 
must  be  notified  so  that  security  guards  are  scheduled  for 
the  trip,  security  code  pages  are  available,  and  the  secu¬ 
rity  forces  in  the  vicinity  of  the  LF  or  LCF  to  be  visited 
are  notified.  The  applicable  maintenance  shop  chief  must 
insure  that  the  scheduled  maintenance  team  is  trained  and 
proficient  in  the  tasks  it  will  be  performing.  All  neces¬ 
sary  repair  parts  must  also  be  available  for  the  job.  Since 
many  teams  are  dispatched  each  day  to  perform  many  different 
maintenance  tasks  at  several  different  LCFs  and  LFs,  the 
coordination  required  between  the  various  activities  is 
tremendous . 

Most  supervision  of  the  team  must  be  accomplished 
prior  to  the  team  departing  the  base.  Once  off  the  base, 
the  team  is  on  its  own  to  get  to  the  LF  or  LCF,  get  the  job 
done,  and  return  to  base  prior  to  the  expiration  of  the  16 
hour  duty  day  limitation.  While  the  maintenance  team  is  at 
the  LF  or  LCF,  they  have  limited  communication  with  JC  via 
the  Maintenance  Communication  Network  ( 13 i 3-72). 
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Quality  Control  (QC)  Responsibilities 

QC  sections  have  been  organized  within  SAC  Mi nut era an 
ICBM  wing  maintenance  organizations  to  Insure  that  quality 
maintenance  is  accomplished  at  the  LF  and  LCF.  QC  is  a 
division  within  the  Deputy  Commander  for  Maintenance  (DCM) 
complex  (13il0-l).  Figure  1  depicts  the  organizational 
chart  for  the  DCM  complex. 

The  general  responsibilities  of  QC  include  the  fol¬ 
lowing! 


1.  The  QC  inspection  and  evaluation  program  pro¬ 
vides  a  capability  for  sampling  the  condition  of  equip¬ 
ment,  the  qualifications  of  maintenance  personnel,  and 
the  soundness  of  management. 

2.  The  evaluation  of  deficiencies  and  problem  areas 
are  also  key  functions  of  quality  control.  By  determin¬ 
ing  probable  causes  of  problems  and  recommending  correc¬ 
tive  actions  to  supervisors,  quality  control  can  sig¬ 
nificantly  enhance  the  quality  of  maintenance. 

3.  QC  is  the  primary  advisory  agency  on  matters  of 
technical  techniques  and  procedures  in  the  Deputy  Com¬ 
mander  for  Maintenance  complex.  As  such,  it  assists  the 
DCM  and  other  maintenance  supervisors  in  the  resolution 
of  maintenance  problems. 

4.  QC  must  assure  that  technical  and  management 
procedures  are  adhered  to  throughout  the  maintenance 
complex. 

5.  Perform  Inspections  of  maintenance  actions,  pro¬ 
cedures,  equipment,  and  facilities. 

6.  Provide  information  to  maintenance  analysis  for 
identification  of  significant  trends  during  activity, 
technical,  and  special  inspections  £l3il0-l]. 


Technical  inspections.  Maintenance  team  technicians  are 
evaluated  by  the  QC  section  on  their  ability  to  perform 
various  maintenance  tasks.  QC*s  inspection  and  evaluation 
requirements  for  measuring  the  quality  of  technician  per¬ 
formance  is  specified  in  SACR  66-6,  Volume  I,  under  the 
ICBM  MSEP  (12 i 2-7). 
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DEPUTY  COMMANDER 


Figure  1.  Organizational  Chart  for  the  DCM  Complex  (l3il-2) 


To  insure  chat  their  responsibilities  are  met,  QC 
performs  technical  inspections.  Technical  inspections  are 
performed  to  determine  equipment  condition  and  quality  of 
maintenance.  These  are  the  types  of  inspections  that  this 
research  was  concerned  with.  There  are  two  types  of  tech¬ 
nical  inspections!  verification  inspections  (VI)  and  spot 
inspections  (SI) .  Vis  are  an  after-the-fact  inspection  and 
are  used  to  insure  that  maintenance  actions  have  been  accom¬ 
plished  correctly.  Sis  are  performed  to  determine  the  ade¬ 
quacy  of  maintenance  actions  in  progress  (13i10-5). 

A  technician  is  required  to  have  an  initial  evalua¬ 
tion  within  six  months  after  being  declared  proficient  as  a 
technician  (12i4-3).  An  annual  evaluation  is  required  no 
later  than  twelve  months  from  the  completion  of  the  last 
evaluation  cycle  (12i4-4).  A  cycle  is  the  period  beginning 
when  the  technician  is  liable  for  evaluation  on  his  first 
task  through  the  time  when  the  seventh  task  is  evaluated. 
This  period  can  be  any  length  of  time  up  to  a  year. 

A  technician  must  be  evaluated  and  graded  at  least 
qualified  on  a  minimum  of  seven  certified  tasks  to  complete 
an  initial  or  annual  evaluation.  A  minimum  of  20  percent  of 
the  authorized  technicians  in  each  workcenter  must  be  com¬ 
pletely  evaluated  from  portal -to-portal  (l2«4-2).  A 
portal-to-portal  evaluation  is  one  that  begins  at  the  pre¬ 
departure  briefing  and  terminates  with  the  debriefing.  The 
tasks  to  be  evaluated  are  determined  by  QC  personnel  but 


8 


must  represent  a  broad  variety  of  all  the  tasks  that  the 
technician  has  been  trained  to  perform  and  on  which  the 
technician  has  achieved  at  least  a  five  skill  level.  The 
evaluations  are  generally  conducted  on  a  no-notice  basis 
unless  the  evaluation  will  be  the  technician's  initial  one 
following  training  ( 12  *  3-1) • 

The  responsibilities  of  QC  in  the  performance  of 
technical  inspections  include i 

1.  Meeting  the  inspection  requirements  of  Table  1. 

2.  Checking  applicable  in-use  inspection  workcards, 
checklists,  and  code  manuals  during  technical  inspec¬ 
tions.  Those  found  outdated,  unserviceable,  or  overdue 
verification  checks  will  be  removed  from  service. 

3.  Adjusting  the  scope  and  depth  of  technical 
inspections  to  satisfy  changing  requirements  £l3il0-6]. 


Performance  errors.  During  an  inspection  of  a  technician's 
task  performance,  the  QC  inspector  notes  any  errors  per¬ 
formed  during  the  performance  of  the  tasks.  There  are  three 
categories  of  errors i  Category  1  is  a  critical  error. 
Category  II  is  a  major  error,  and  Category  III  is  a  minor 
error. 


A  Category  I  error  is  an  automatic  failure.  It  is 
an  error  that  resulted  in  or  could  have  resulted  ini 

1.  Injury  to  any  person  preventing  performance  of 
duties  during  the  cask  being  evaluated. 

2.  Damage  to  any  item  which  would  prevent  it  from 
being  immediately  used  for  its  intended  purpose.  This 
includes  the  item  being  worked  on,  all  support  equip¬ 
ment,  and,  with  the  exception  of  common  hand  tools,  any 
other  item  in  the  work  area. 

3.  Nuclear  accidents  or  incidents. 

4.  Failure  to  accomplish  critical  portions  of  the 
task,  resulting  in  incomplete  task  performance. 
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Table  1 

Quality  Control  Minimum  Inspection  Requirements  (13i10-7) 
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Launch  test  100  percent  of  each 

facilities.  refurbishment  or  each 

facility  at  least 
biennially. 


Table  1  (Continued) 
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5.  Violation  of  the  weapon  system  safety  rules 
(AFR  122  series). 

6.  Failure  to  recognize/ correct  an  unacceptable 
condition/ check/ test  result. 

7.  Failure  to  recognize  an  acceptable  condition/ 
check/test  result  which  resulted  in  an  unacceptable 
time  delay  or  in  the  rejection  of  serviceable  compo¬ 
nents  or  equipment. 

8.  Security  compromise  £l2i3-4]. 

A  Category  II  error  is  an  error  that  resulted  in  or 
could  have  resulted  ini 


Mi.  , . 


1.  Damage  to  any  item  which  did  not  prevent  it 
from  being  immediately  used  for  its  intended  purpose, 
but  required  repair  or  had  a  detrimental  effect  on  the 
operational  life  of  that  item.  This  includes,  but  is 
not  limited  toi 

a.  Improper  use  of  test  equipment. 

b.  Improper  corrosion  control. 

2.  Damage  to  common  hand  tools  caused  by  misuse 
or  neglect. 

3.  Excessive  maintenance  tiraej  however,  the  task 
was  successfully  completed.  This  includes,  but  is  not 
limited  toi 

a.  Delay (s)  attributable  to  insufficient  job 
knowledge,  planning,  coordination,  or  supervision. 

b.  Unnecessary  troubleshooting. 

c.  Needless  removal  or  replacement  of  compo¬ 
nents  or  equipment. 

d.  Failure  to,  in  a  timely  manner,  recognize 
an  acceptable/unacceptable  condition/ check/ test 
results . 

4.  Administrative  security  deviation. 

5.  Injury  to  any  person  which  did  not  prevent 
his/her  performance  of  assigned  duties  (superficial 
injuries  such  as  scratches,  cuts,  or  bruises,  not 
caused  by  misuse  of  equipment  or  violations  of  safety 
procedures  are  not  considered  errors). 

6.  Failure  to  make  an  inspection/check/test, 
which  if  not  accomplished,  would  result  in  a  possible 
hardness  degradation  or  allow  an  unknown  condition  to 
exist  Cl2i3-4J. 

A  Category  III  error  is  any  error  that  lacks  the 
seriousness  to  meet  the  criteria  for  a  critical  or  major 
error.  A  minor  error  does  not  necessarily  result  in  a 
failure  of  the  evaluation  (12i3-4). 
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Performance  grades.  At  the  completion  of  the  evaluation  the 
technician  Is  given  a  grade  for  his  performance.  Grades 
are  t 

1.  Highly  qualified  (H).  Performance  of  the  over¬ 
all  task  exceeded  the  acceptable  level. 

2.  Qualified  (Q) .  Performance  of  functions  was 
acceptable. 

3.  Unqualified  (UQ) *  Performance  of  one  or  more 
functions  was  unacceptable  £l2i3-5]. 

The  procedures  for  determining  the  grades  arei 

1.  List  all  errors  noted  during  the  task  perform¬ 
ance. 

2.  Determine  the  category  and  type  of  each  error. 

3.  Compare  the  overall  task  performance  with  the 

frade  criteria  in  Table  £2]  to  assign  the  grade 
12 i 3-5] . 

3901  Strategic  Missile  Evaluation  Squadron 

SAC  delegated  to  the  3901  Strategic  Missile  Evalua¬ 
tion  Squadron  (SMES)  the  primary  function  of  evaluating  and 
rating  a  wing's  ICBM  maintenance  personnel  and  equipment. 
SMES  conducts  these  evaluations  on  a  scheduled  basis  every 
nine  months.  SMES  personnel  evaluate  a  random  sample  of 
the  various  workcenter's  technicians  as  they  perform  main¬ 
tenance  actions.  SMES  also  conducts  evaluations  of  QC  per¬ 
sonnel  and  training  Instructors.  In  the  area  of  personnel 
evaluations,  the  entire  maintenance  complex  must  achieve  a 
90  percent  pass  rate  In  order  to  attain  a  satisfactory 
rating.  Accordingly,  each  workcenter  must  also  achieve  a 
90  percent  pass  rate  In  order  to  be  rated  satisfactory.  The 
evaluations  are  conducted  In  exactly  the  same  manner  that 
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No  Category  II 


Table  2  (Continued) 


wing  QC  personnel  conduce  their  evaluations  and  technicians 
are  graded  according  to  the  same  criteria.  In  the  area  of 
hardware  and  equipment  Inspection,  SMES  Inspectors  will 
evaluate  missile  maintenance  support  equipment,  tools,  and 
vehicles  to  verify  operability.  The  evaluators  will  also 
randomly  pick  a  number  of  missile  sites  to  conduct  extensive 
inspections  of  site  condition  and  ability  of  the  site  to 
function  correctly  In  time  of  war  (l2«6-7). 

Problem  Statement 

Statistical  quality  control  techniques  have  been 
developed  to  control  and  improve  quality  through  the  appli¬ 
cation  of  statistical  techniques  and  probability  laws. 
Statistical  techniques  can  be  applied  in  order  to  achieve 
maximum  conformance  to  established  maintenance  inspection 
standards.  Through  the  use  of  statistical  sampling  methods 
it  can  be  determined  whether  or  not  the  maintenance  con¬ 
ducted  meets  acceptable  quality  requirements.  Statistical 
techniques  can  be  used  to  determine  an  appropriate  sample 
size  to  be  Inspected.  The  problem  for  research  was  to 
determine  if  a  Maintenance  Standardization  and  Evaluation 
Program  Inspection  sample  size  can  be  more  efficiently  and 
effectively  determined  at  the  wing  level  in  order  to  control 
the  quality  of  maintenance  performed  at  the  missile  sites. 
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Scope 


This  research  was  limited  co  Che  analysis  of  the 
MSEP  ac  SAC's  321  Strategic  Missile  Ming  at  Grand  Forks 
Air  Force  Base,  North  Dakota.  The  analysis  was  restricted 
to  maintenance  actions  and  MSEP  evaluations  conducted  in 
1978.  The  evaluation  was  concerned  with  maintenance 
actions  and  associated  MSEP  evaluations  conducted  on  the 
LFs  and  LCFs  and  was  not  concerned  with  in-shop  mainte¬ 
nance. 

Research  Objectives 

The  objectives  of  this  research  were  toi 

1.  Develop  a  procedure  by  which  a  maintenance 
sample  size  could  be  determined  at  the  wing  level  to  con¬ 
trol  maintenance  quality. 

2.  Ascertain  the  ramifications  of  this  procedure 
in  terms  of  increasing  the  efficiency  and  effectiveness 
of  maintenance  quality  control. 

Research  Question 

The  question  to  be  answered  in  this  research  wasi 
Can  the  ICBM  MSEP  inspection  sample  size,  at  a  selected 
base,  be  more  efficiently  and  effectively  determined  at 
the  wing  level? 

Justification 

SAC's  primary  mission  is  to  maintain  the  ability 
to  deter  potential  enemies  from  attacking  the  United 
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States  (U.S.)  and,  in  the  event  the  U.S.  is  attacked,  to 
provide  a  second  strike  capability  (l5il-2).  The  ability 
of  SAC  to  carry  out  its  mission  relies  heavily  upon  the 
reliability  of  SAC's  hardware  and  consequently  its  main¬ 
tenance  quality.  It  is  incumbent  upon  SAC  to  continually 
review  its  I CBM  management  procedures  to  insure  that  all 
activities  are  performing  effectively. 

SAC's  management  must  be  Innovative  and  flexible. 

It  should  be  Innovative  in  order  to  find  better,  more 
economical  ways  of  doing  the  job.  It  should  be  flexible 
to  successfully  cope  with  new  situations.  Both  of  these 
qualities  are  in  ever  Increasing  demand  as  fewer  dollars 
become  available  to  support  the  mission  (l3il-2). 

The  increasing  scarcity  of  resources  impacts  Air 
Force  operations  at  every  level.  The  rising  costs  of 
resources  is  a  major  concern  to  the  Air  Force  since  it 
affects  its  ability  to  perform  its  mission.  The  Air  Force 
mission  has  not  diminished  in  recent  years  while  its  budget 
in  real  dollars  has  been  shrinking.  Undersecretary  of 
Defense  for  Research  and  Engineering,  William  J.  Perry, 
testified  before  the  House  Appropriations  Committee  that 
the  cost  of  military  fighter  aircraft  has  been  increasing 
10  fold  every  20  years  since  World  War  2.  If  this  trend 
continues,  Perry  said,  and  the  Defense  Department  budget 
increases  only  3  percent  per  year,  by  the  year  2110  the 
Pentagon  will  need  to  spend  its  entire  budget  to  buy  a 
single  aircraft  (16»11). 
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Because  of  the  Lncreased  cost  of  resources,  today's 
Air  Force  managers  must  take  necessary  actions  to  Insure 
maximum  utilization  of  time,  men,  and  material.  The  effec¬ 
tive  and  efficient  management  of  the  Air  Force's  maintenance 
quality  control  Is  of  ever  Increasing  Importance.  A  sound 
quality  control  program  can  make  significant  savings  In 
both  direct  and  Indirect  costs.  For  example,  effective  con¬ 
trol  of  the  quality  of  maintenance  performed  on  equipment 
can  prevent  unnecessary  equipment  down  time.  High  quality 
assurance  of  maintenance  will  also  Increase  equipment  reli¬ 
ability. 

Literature  Review 

The  guidance  and  concepts  of  MSEP  as  contained  In 
the  various  Air  Force  directives  have  already  been  dis¬ 
cussed  and  no  further  review  of  them  Is  necessary.  Further, 
a  complete  history  of  MSEP  development  was  beyond  the  scope 
of  this  research.  There  are  a  number  of  statistical 
approaches  to  sample  size  determination  that  are  in  use  in 
the  military  and  civilian  sector  that  do  warrant  consider¬ 
ation,  however.  The  literature  review  was  devoted  to  those 
applicable  publications  pertaining  to  the  development  of 
sample  sizes,  their  application  in  the  military,  and  pre¬ 
vious  research  conducted  in  the  area  of  sample  size  deter¬ 
mination  In  an  Air  Force  maintenance  environment. 
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Acceptance  sampling  overview.  Acceptance  sampling  is  used 
to  determine  what  percentage  of  products  conform  to  estab¬ 
lished  specifications.  In  the  maintenance  function,  this 
equates  to  determining  what  percentage  of  maintenance 
actions  performed  conform  to  technical  order  specifications. 
Acceptance  sampling  is  based  on  the  statistical  concept 
chat  a  random  sample  of  appropriate  size  will  have  within  it 
a  proportional  representation  of  all  the  items  in  the  parent 
population.  An  estimation  of  product  quality  is  obtained 
through  sampling  to  determine  if  100  percent  inspection 
should  be  part  of  the  production  process.  There  are  two 
general  ways  of  describing  the  degree  of  conformance  to 
quality  specifications  in  acceptance  sampling.  One  measures 
attributes  and  the  other  measures  variables.  Attribute 
measurements  involve  a  simple  determination  of  whether  or 
not  the  product  is  "good"  or  "bad"j  while  the  measurement  of 
variables  involves  the  determination  of  how  much  the  product 
varies  from  other  units  or  from  design  specifications.  The 
use  of  attributes  in  acceptance  sampling  is  generally  based 
on  the  binomial  statistical  distribution.  Acceptance  sam¬ 
pling  is  executed  through  the  development  of  a  sampling  plan 
(1.195). 

A  literature  review  of  the  various  types  of  sampling 
plans  would  not  have  been  relevant  to  the  problem  posed  in 
this  thesis.  The  purpose  of  this  research  was  to  show  that 
a  more  effective  and  efficient  method  of  determining  an 


appropriate  sample  size  for  maintenance  quality  verification 
could  be  found  than  what  is  currently  being  done  in  1CBM 
maintenance.  The  liters ture  review  focused  on  the  various 
approaches  used  for  only  one  type  of  sampling  plant  the 
single  sampling  plan.  This  type  of  plan  was  deemed  to  be 
the  most  appropriate. 

Single  sampling  plan.  Chase  and  Acquilano  state  that  a 
single  sampling  plan  is  defined  by  (n)  and  (c),  where  (n) 
is  the  number  of  units  in  the  sample,  and  (c)  is  the  accep¬ 
tance  number.  The  size  of  (n)  may  vary  from  1  up  to  the 
entire  population  of  the  parent  group  or  lot  from  which  it 
is  drawn.  The  acceptance  number  (c)  denotes  the  maximum 
number  of  defective  items  that  can  be  discovered  in  the 
sample  before  the  entire  lot  is  rejected  (Iil97). 

Values  for  (n)  and  (c)  are  determined  from  the 
interaction  of  four  factors  that  quantify  the  objectives  of 
the  producer  and  the  consumer  of  the  product.  The  four 
factors  are  producer’s  risk,  consumer's  risk,  acceptable 
quality  level,  and  lot  tolerance  percent  defective.  The 
objective  of  the  producer  is  to  assure  that  the  sampling 
plan  has  a  low  probability  of  rejecting  good  lots.  Lots 
are  defined  as  acceptable  if  they  contain  no  more  than  a 
specified  level  of  defectives,  called  the  acceptable  quality 
level  (AQL) .  The  objective  of  the  consumer  is  to  assure 
that  a  sampling  plan  has  a  low  probability  of  accepting  bad 
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lots.  Lots  are  defined  as  not  acceptable  if  the  percentage 
of  defectives  is  greater  than  a  specified  amount,  termed  lot 
tolerance  percent  defective  (LTPD).  The  probability  associ¬ 
ated  with  rejecting  a  bad  lot  is  denoted  by  the  Greek  letter 
beta,/?,  and  is  called  the  consumer's  risk.  The  probability 
associated  with  rejecting  a  good  lot  is  denoted  by  the 
Greek  letter  alpha,  »<.,  and  is  termed  the  producer's  risk. 

The  selection  of  particular  values  for  AQL,/? ,  LTPD,  and  =* 
is  an  economic  decision  based  on  cost  tradeoffs.  The  more 
protection  a  consumer  or  producer  desires,  the  more  it  will 
cost.  A  determination  of  (n)  and  (c)  is  made  from  these 
values  as  based  on  various  tables  and  graphs  located  in 
quality  control  handbooks.  An  operating  characteristic 
(OC)  curve  can  then  be  constructed  which  will  describe  how 
well  the  sampling  plan  discriminates  between  good  and  bad 
lots  (It  197) . 

Another  approach  to  constructing  a  single  sampling 
plan  is  presented  by  Dodge  and  Roraig,  They  provide  a  com¬ 
plete  series  of  tables  for  single  sampling  plans.  Their 
approach  is  to  provide  tables  for  various  values  of  LTPD. 
Appropriate  sample  sizes  (n),  and  acceptance  numbers  (c), 
can  be  determined  from  the  appropriate  table  through  a 
determination  of  the  lot  size  and  process  average.  Dodge 
and  Roraig  also  provide  OC-curves  for  use  in  discriminating 
between  good  and  bad  lots  (2i4),  A  further  analysis  of 
this  approach  is  covered  in  Chapter  2. 
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Duncan’s  approach  to  a  single  sampling  plan  is  very 
similar  to  both  Chase  and  Acquilano  and  Dodge  and  Romig, 
but  with  differentiation  between  types  of  0C- curves .  Duncan 
draws  a  comparison  between  type  A  OC-curves  and  type  B  0C- 
curves.  A  type  A  0C- curve  provides  the  probability  of 
accepting  an  isolated  lot.  The  type  A  0C- curve  describes 
how  a  consumer  is  likely  to  view  the  operating  character¬ 
istics  of  a  sampling  plan  when  he  obtains  isolated  lots  of 
material  or  thinks  about  the  quality  of  individual  lots 
rather  than  the  average  quality  of  a  stream  of  lots.  The 
type  B  OC-curve  describes  how  a  consumer  is  likely  to  view 
the  operating  characteristics  of  a  sampling  plan  when  he 
is  buying  a  steady  supply  of  material  from  a  given  supplier. 
The  type  B  OC-curve  gives  the  probability  of  accepting  a  lot 
from  a  randomly  operating  process  turning  out  a  product  of 
average  quail ty  ( 3 i 149 ) . 

Military  applications  of  single  sampling  plan.  Military 
application  of  the  single  sampling  plan  is  governed  by  the 
specifications  of  MIL-STD-105D.  The  sampling  plans  in 
MIL-STD-135L  are  applicable  to  the  inspection  of  end  items, 
components  and  raw  materials,  operations,  materials  in  proc¬ 
ess,  supplies  in  storage,  maintenance  operations,  data  or 
records,  and  administrative  procedures.  Sample  sizes  are 
determined  using  a  combination  of  average  quality  level 
(AQL),  the  maximum  percent  defective  that  for  purposes  of 
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sampling  inspection,  can  be  considered  satisfactory  as  a 
process  average,  and  lot  size.  Tables  and  appropriate  0C- 
curves  are  provided  in  MIL-STD-105D  for  different  types  of 
sampling  plans.  MIL-STD-105D  is  followed  specifically  by 
military  contract  representatives  who  are  charged  with  the 
responsibility  of  insuring  that  contractors  are  selling 
quality  products  to  the  military.  MIL-STD-105D  is  also 
used  as  a  basis  for  quality  control  at  the  various  Air 
Logistics  Centers  when  they  are  conducting  their  day-to-day 
maintenance  operations.  Of  particular  interest  was  the 
fact  that  MIL-STD-105D  is  used  to  determine  sample  sizes  at 
Ogden  Air  Logistic  Center  where  depot  level  maintenance  is 
performed  on  the  Minuteman  missile  components  (8) . 

Previous  research  to  determine  MSEP  sample  size.  William  A. 
Mitchell  conducted  a  study  to  show  that  local  determination 
of  MSEP  sample  size  leads  to  a  more  efficient  and  effective 
use  of  QC  resources  than  if  sample  sizes  are  dictated  by 
MAJCOMS .  The  study  dealt  with  an  aircraft  wing  in  United 
States  Air  Forces  Europe  (USAFE) .  Mitchell  asked  whether 
the  sample  totals  directed  by  USAFE  accurately  reflect  what 
they  are  supposed  to.  He  proposed  that  local  managers 
should  be  allowed  to  determine  those  areas  where  quality 
control  emphasis  should  be  placed  and  schedule  inspections 
accordingly.  The  number  of  inspections  should  be  based  on 
the  confidence  level  desired  by  local  management.  Mitchell 
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showed  chat  the  higher  the  confidence  level  desired,  the 
more  Inspections  were  required.  He  provided  a  methodology 
for  sample  size  determination  for  MSEP  evaluations  based  on 
the  desired  confidence  level.  He  drew  a  comparison  between 
what  USAFE  guidance  would  have  dictated  a  sample  size  to  be 
in  a  hypothetical  situation  and  what  his  methodology  would 
dictate  the  sample  size  to  be.  He  showed  that  command 
guidance  would  have  led  to  a  lower  confidence  level  In  his 
example  than  what  his  methodology  would  have  provided  (9i54), 
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CHAPTER  2 


METHODOLOGY 

Overview 

This  chapter  outlines  the  approach  used  in  the 
analysis  of  the  problem  posed  in  this  research.  The  chap¬ 
ter  is  divided  into  four  sections.  The  first  section  pro¬ 
vides  the  sources  of  data  and  information  used  in  the 
report.  The  second  section  contains  the  procedure  for  the 
determination  of  a  statistical  sample  size  that  could  be 
used  by  maintenance  QC  personnel.  The  third  section 
explains  the  procedure  for  comparing  the  calculated  sample 
size  for  each  workcenter  with  what  was  actually  evaluated 
by  the  QC  section  of  the  321  SMW  and  with  what  SAC  require¬ 
ments  were,  in  accordance  with  SACR  66-6.  The  chapter 
concludes  with  a  listing  of  the  assumptions  and  limitations 
associated  with  the  methodology. 

Data 

The  number  of  maintenance  actions  performed  by  each 
dispatching  workcenter  constituted  the  population  size  (N) 
and  was  obtained  from  the  1978  Maintenance  Summary  Report 
for  the  321  SMW  at  GFAFB.  A  dispatching  workcenter  is  a 
maintenance  workcenter  whose  primary  tasks  are  performed  at 
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a  missile  site.  The  workcenters  involved  were  the  Periodic 
Inspection  Teams  (PIT),  Electro -mechanical  Teams  (EMT), 
Combat  Targeting  Teams  (CTT),  Missile  Handling  Teams  (MHT) , 
Facility  Maintenance  Teams  (FMT) ,  Site  Security  Maintenance 
Teams  (SSMT),  and  the  Missile  Maintenance  Teams  (>MT).  The 
number  of  MSEP  evaluations  performed  by  QC  In  each  dispatch¬ 
ing  workcenter  for  1978  were  retrieved  from  the  Maintenance 
Personnel  Evaluation  Reporting  System  (MPERS)  at  GFAFB. 

MPERS  was  also  used  to  obtain  the  evaluation  pass  rate  per 
dispatching  workcenter.  The  number  of  personnel  subject  to 
MSEP  evaluation  per  dispatching  workcenter  was  obtained 
from  the  1978  Maintenance  Summary. 

Sample  Size  Determination 

The  Dodge-Romig  system  for  determination  of  sample 
size  in  quality  control  activities  was  used  with  the  data 
obtained  from  the  test  base  (2i4).  The  series  of  steps 
applied  to  this  study  werei 

1.  Decide  what  characteristics  to  include  in  the 
Inspection.  SACR  66-6  states  that  QC  inspections  will 
constitute  a  representative  sample  of  maintenance  actions 
that  the  technician  is  authorized  to  perform  C 12 1 3-1) .  In 
this  research  the  characteristics  included  were  all  the 
completed  maintenance  actions  by  each  workcenter  regardless 
of  priority.  The  total  number  of  maintenance  actions  com¬ 
pleted  by  each  dispatching  workcenter  constituted  the  lot 
size  from  which  the  sample  size  was  determined. 
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2.  Decide  on  the  type  of  protection  required  for 
the  sample  size  determination.  The  protection  required 
depends  upon  the  amount  of  allowable  defects  or  failures 
allowed  before  the  whole  lot  is  considered  to  be  below 
standards.  Two  types  of  protection  plans  are  Average  Out* 
going  Quality  Level  (AOQL)  and  Lot  Tolerance  Percent  Defec¬ 
tive  (LTPD).  AOQL  plans  set  a  limit  to  the  average  quality 
of  the  lots  inspected.  As  the  percent  defective  of  the 
lots  increases,  the  samples  trill  be  rejected  at  an  increas¬ 
ing  rate.  Rejected  lots  must  be  100  percent  inspected.  As 
the  rejection  level  increases,  the  number  of  items  inspected 
increases.  The  level  of  outgoing  quality,  therefore,  in¬ 
creases  after  a  certain  level  of  defectives  is  reached. 

Thus,  average  quality  of  the  lots  reaches  an  average  out¬ 
going  quality  limit. 

Sampling  plans  utilizing  LTPD  limit  the  number  of 
defectives  in  each  lot  sampled.  The  emphasis  of  LTPD  sam¬ 
pling  plans  concentrates  on  quality  levels  of  every  individ¬ 
ual  lot,  not  the  average  quality  of  numerous  lots.  Each 
lot  is  sampled  to  insure  the  quality  of  the  lot  is  accept¬ 
able.  For  this  study  the  lot  consisted  of  all  the  mainte¬ 
nance  actions  conducted  by  a  maintenance  workcenter  during 
a  one  year  period.  Therefore,  the  LTPD  sampling  plan  was 
chosen  over  the  AOQL  plan.  The  value  used  for  the  LTPD  plan 
was  10  percent.  This  figure  was  based  on  the  MSEP  grading 
criteria  in  SACR  66-6  which  states  that  at  least  a  90  percent 
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pass  rate  must  be  achieved  by  each  workcenter  in  the  person- 
nel  proficiency  program  for  that  workcenter  to  be  Judged  as 
satisfactory  (12i6-7). 

Whenever  a  sampling  plan  is  used  in  lieu  of  100  per¬ 
cent  inspection  of  all  items ,  the  consumer  (SAC)  and  the 
producer  (a  maintenance  workcenter)  are  taking  risks.  For 
the  sake  of  economy  the  consumer  must  accept  that  some 
defectives  will  go  undiscovered  in  each  lot.  The  consumer 
must  also  accept  the  fact  that  some  lots  which  exceed  the 
acceptable  defective  rate  will  be  accepted  as  good  lots 
(2 1 12).  A  consumer’s  risk  (/3)  of  .10,  a  risk  common  in 
industrial  practice,  was  used  (1»196).  For  example,  if  a 
lot  size  of  60  maintenance  actions  contained  more  than  6 
defectives,  the  lot  size  would  be  identified  as  bad  90 
percent  of  the  time,  on  the  average. 

The  producer  (a  maintenance  workcenter)  like  the 
consumer  takes  risks  when  a  sampling  plan  is  used  in  lieu 
of  100  percent  inspection.  The  producer's  risk  («<)  is  the 
probability  that  a  lot  which  actually  meets  the  acceptable 
quality  level  will  be  rejected  as  bad  on  the  basis  of  the 
inspected  sample.  A  producer's  risk  of  .05  was  used  as 
it  is  one  commonly  used  for  Industrial  practice  (lil96). 

The  producer's  risk  is  directly  related  to  the  average  rate 
of  defectives  produced  (the  process  average).  The  sampling 
plana  were  constructed  based  on  given  process  averages.  If 


che  actual  process  average  changes,  the  producer's  risk  and 
consumer's  risk  vary. 

For  a  given  lot  size,  numerous  combinations  of  sample 
size  (n)  and  acceptable  number  of  defectives  (c)  could  be 
selected  to  achieve  the  desired  consumer's  risk  (.10)  and 
producer's  risk  (.05).  The  objective  of  a  sampling  plan  is 
to  provide  che  most  efficient  adjustment  between  consumer's 
risk  and  producer's  risk  from  the  standpoint  of  minimizing 
inspection  effort. 

3.  Decide  whether  to  use  a  single,  double,  or 
multiple  sampling  plan.  In  a  quality  program,  QC  personnel 
have  the  option  of  single,  double,  or  multiple  sampling. 
Single  sampling  requires  the  quality  inspector  to  examine 
a  specified  number  of  randomly  selected  items  from  the  lot 
size  in  question.  If  the  number  of  "bad  items"  in  the 
sample  exceeds  the  allowable  number  determined  by  che  sam¬ 
pling  plan,  the  entire  lot  is  rejected  as  unacceptable 
without  further  sampling.  If  the  number  of  "bad  items"  in 
the  sample  size  does  not  exceed  the  allowable  number  deter¬ 
mined  by  the  sampling  plan  the  lot  size  is  accepted  as  good 
without  further  sampling. 

Double  and  multiple  sampling,  unlike  single  sam¬ 
pling,  may  require  examination  of  additional  items  from  the 
lot  size  in  question.  This  is  because  the  acceptable  number 
of  "bads"  for  acceptance  of  the  lot  size  may  be  less  than 
the  required  number  of  "bads"  for  rejection  of  the  lot  size. 


If  the  number  of  "bads"  detected  in  the  first  sample 
exceeds  the  acceptance  number  and  is  less  than  the  rejec¬ 
tion  number,  one  or  more  additional  samples  must  be  taken 
before  the  lot  size  can  be  rejected  or  accepted  (2i9-l5). 

This  thesis  used  single  sampling  because  it  most 
closely  correlated  to  the  evaluation  method  used  by  the 
3901  SMES  team.  A  single  sampling  plan  is  congruent  with 
the  3901  SMES's  "acceptance -rejection"  policy.  If  the 
number  of  failures  detected  through  MSEP  is  greater  than 
10  percent,  the  workcenter's  maintenance  production  quality 
is  judged  to  be  below  standards  (12i6-8).  SAC's  policy  is 
consistent  with  the  single  "acceptance-rejection"  number  of 
bad  items  provided  by  the  single  sampling  plan.  If  the 
percentage  of  bad  maintenance  is  greater  than  10  percent, 
the  quality  is  not  being  controlled  for  chat  workcenter. 

An  increased  emphasis  on  quality  verification  from  then  on 
would  be  required  until  maintenance  quality  was  again 
within  tolerance. 

4.  Select  an  appropriate  sampling  table  for  the 
parameters  selected.  Table  3  was  used  for  sample  size 
determination.  The  table  is  for  a  single  sampling  plan 
with  an  LTPD  of  10  percent,  a  consumer's  risk  (/3)  of  10 
percent,  and  a  producer's  risk  (<V)  of  .05. 

5.  Determine  an  estimate  of  the  appropriate  proc¬ 
ess  average  (PA).  PA  is  the  process  average  percent  defec¬ 
tive.  It  is  the  average  percent  of  defectives  produced  by 
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Table 
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Che  process  in  a  given  period  of  cime.  PA  is  determined  by 
dividing  che  number  of  failures  by  Che  number  in  Che  sample 
size.  PA  for  a  dispatching  work center,  Chen,  was  Che  cocal 
number  of  evaluation  failures  divided  by  che  total  number  of 
evaluations  conducted  by  QC.  PA  equaled  the  overall  pass 
rate  for  a  particular  workcenter  subtracted  from  1.00. 

6.  Select  the  appropriate  sample  size  from  Table  3. 
The  sample  size  for  a  workcenter  was  determined  by  locating 
che  column  with  its  computed  process  average  and  going  down 
that  column  until  it  intersected  with  the  row  containing  the 
appropriate  lot  size.  The  number  that  resulted  from  this 
intersection  was  the  determined  sample  size.  For  chose 
cases  where  the  process  average  was  greater  than  5  percent, 
a  process  average  of  5  percent  was  used.  Dodge  and  Romig 
state  that  when 

.  .  .  the  PA  ...  is  estimated  to  be  larger  than 
the  largest  PA  value  given  in  the  table  choose  the 
sampling  plan  corresponding  to  the  largest  PA  in  tlje 
table  (the  last  column)  and  to  the  given  lot  size  j_2 « 7 J . 

7.  Find  the  operating  characteristic  (OC)  curve  of 
the  inspection  sample  and  the  overall  maintenance  task  popu¬ 
lation.  The  problem  of  choosing  an  acceptance  sampling  plan 
centered  on  how  it  would  perform  in  action.  This  was  best 
explained  graphically  by  the  OC- curve.  As  previously 
stated,  there  are  two  distinct  types  of  OC-curvesi  Type  A 
and  Type  B. 
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Type  A  OC- curves  are  associated  with  single  lot 
sizes  with  finite  populations.  This  was  the  case  with  the 
maintenance  workcenters  under  study.  The  lot  sizes  were 
finite  in  size  and  the  study  pertained  to  the  probability 
of  accepting  specific  lots. 

Type  B  OC- curves  are  associated  with  sampling  from 
an  infinite  universe  and  are  compatible  with  AOQL  sampling 
plans. 

As  the  lot  size  gets  large,  the  Type  A  OC-curve 
rapidly  approaches  the  OC-curve  for  infinite  lots.  The 
Type  A  OC-curve  for  an  infinite  lot,  however,  is  mathe¬ 
matically  identical  to  a  Type  B  OC-curve.  A  Type  B  OC- 
curve,  therefore,  can  be  used  as  a  good  approximation  to  a 
Type  A  OC-curve  when  lots  are  large;  for  example,  lots  10 
times  the  sample  size  (3*150-151). 

For  this  study  Type  B  OC-curves  were  used  to 
approximate  the  Type  A  OC-curves  in  accordance  with  the 
following  steps  outlined  by  Dodge  and  Roraig  (2*55).^  If 
the  acceptance  number  (c)  is  greater  than  3  or  the  sample 
size  (n)  is  greater  than  500  choose  a  Type  B  curve  with  the 
same  (c)  value  and  closest  value  of  (n)  from  Appendices  1 
and  2  of  Sampling  Inspection  Tables  by  Dodge  and  Romig. 

The  lot  size  (N)  was  disregarded  as  immaterial  (2*55). 

1 

Type  A  OC-curve  was  available  for  MHT  and  an 
approximation  using  Type  B  curves  was  not  required.  The 
curve  was  copied  from  p.  174  of  Inspection  Sampling  Tables 
for  n^35  and  c"l. 
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The  OC -curve  for  a  specific  sampling  plan  graphi¬ 
cally  depicts  the  probability  of  accepting  a  lot  size  with 
a  range  of  actual  percent  defectives.  This  is  illustrated 
in  Figure  2.  The  lot  size  under  inspection  had  an  actual 
percent  defective  of  5  percent.  The  corresponding  proba¬ 
bility  of  acceptance  was  .96.  In  other  words,  if  the  lot 
size  in  question  with  a  5  percent  defective  rate  was 
inspected  with  the  corresponding  sampling  plan,  the  lot 
size  would  be  accepted  96  percent  of  the  time  based  on  the 
sample. 

Procedure  for  Comparing  Statistical 
Sample  Size  and  MSEP  Sample  Size 

The  sampling  plan  (sample  size  and  acceptance 
number)  calculated  by  the  preceding  procedure  will  be  dis¬ 
played  in  tabular  form.  Also  included  in  the  table  will  be 
the  total  maintenance  actions  performed  and  the  average 
number  of  technicians  per  workcenter.  Additionally,  eval¬ 
uations  performed  by  QC,  broken  out  by  the  number  of  tech¬ 
nicians  evaluated  and  the  number  of  maintenance  actions 
evaluated,  and  the  pass  rate  for  each  workcenter  will  be 
shown.  The  number  of  evaluations  that  QC  was  required  to 
administer  in  accordance  with  SACR  66-6  will  also  be 
included.  This  will  be  a  range  of  values  because  an  indi¬ 
vidual  technician  from  a  workcenter  could  have  been  eval¬ 
uated  on  a  single  task  while  a  team  of  technicians  from 
the  same  workcenter  could  have  been  evaluated  on  a  single 
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Percent  Defectives 


.  Operating  Characteristic  Curve--Single 
Sampling  Plan  Average  Outgoing 
Quality  Limit  (AOQL)  =■  2.0%  (2»83) 


tusk  with  each  technician  given  credit  for  an  evaluation. 
This  can  be  Illustrated  tlirough  the  following  example.  If 
a  workcenter  had  20  personnel  assigned  and  they  were  divided 
Into  four  5-man  teams,  the  range  of  evaluation  requirements 
would  bo  from  28  to  140.  It  Is  possible  that  each  member 
of  the  team  could  be  given  an  evaluation  as  the  team  as  a 
whole  was  working  on  one  maintenance  task.  If  this  was 
continually  carried  out  throughout  the  year  for  each  team 
and  technician,  the  total  maintenance  actions  evaluated  for 
the  year  would  be  28,  or  7  tasks  multiplied  by  four  teams. 
Conversely,  It  Is  possible  that  each  member  of  a  team  would 
be  evaluated  on  completely  different  maintenance  actions, 
thus  giving  an  annual  total  for  the  team  of  35  and  hence 
140  maintenance  actions  evaluated  for  the  year.  The  actual 
number  of  maintenance  actions  evaluated  for  the  year  will 
probably  fall  somewhere  between  the  extremes. 

The  sample  size  required  by  MSEP  will  be  compared 
with  the  calculated  statistical  sample  size.  The  comparison 
will  be  to  dotoralne  If  the  MSEP  sample  size  resultod  In  a 
larger  or  smaller  Inspection  size  than  computed  statis¬ 
tically. 

Assumptions  and  Limitations 

1.  All  maintenance  actions  and  evaluations  at  GFAFQ 


were  assumed  to  have  boon  documented  correctly. 


2,  Each  maintenance  action  within  a  workcenter, 
regardless  of  priority,  was  assumed  to  have  had  an  equal 
chance  of  being  selected  for  evaluation, 

3,  No  distinction  was  made  between  critical,  major, 
and  minor  errors.  Data  simply  showed  a  percentage  of  failed 
evaluations  and  the  number  of  evaluations.  No  distinction 
was  made  to  the  types  of  tasks  which  were  evaluated  or  why 
evaluations  were  rated  unsatisfactory. 

4,  While  a  failed  task  may  have  been  the  result  of 
something  other  than  actual  task  workmanship,  other  causes 
of  failures  were  Ignored. 


CHAPTER  3 


DATA  ANALYSIS  AND  RESULTS 


Overview 

A  comprehensive  analysis  of  Che  data  obtained  from 
the  321  SMW  was  used  to  discover  possible  shortcomings  In 
MSEP.  This  chapter  discusses  the  analysis  performed  on  the 
data  and  the  results  obtained.  The  chapter  Is  divided  Into 
three  sections.  The  first  section  presents,  In  tabular 
form,  a  summary  of  the  data  and  the  calculated  sample  size 
derived  using  the  procedure  presented  In  Chapter  2.  A 
complete  explanation  of  the  table  Is  Included.  The  second 
section  Is  a  more  detailed  approach  to  the  Information  pre¬ 
sented  In  the  first  section.  The  data  and  sample  size  are 
discussed  as  they  pertain  to  each  workcenter.  The  chapter 
concludes  with  a  summary  of  all  analysis  results. 

Data  Presentation 

Table  A  provides  a  summary  of  the  data  and  calcula¬ 
tions  obtained  from  the  procedures  outlined  In  Chapter  2. 

An  explanation  of  the  table  follows i 

1.  Column  1  lists  the  dispatching  workcenters. 

2.  Column  2  is  the  number  of  maintenance  tasks 
completed.  These  were  the  maintenance  actions,  scheduled 
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or  unscheduled,  actually  completed  so  that  the  maintenance 
discrepancy  was  eliminated  from  the  Maintenance  Management 
Information  and  Control  System.  The  numbers  only  represent 
actual  maintenance  and  do  not  represent  training  activity 
unless  the  training  Involved  the  elimination  of  an  existing 
maintenance  discrepancy.  The  differences  between  the  number 
of  task  completions  by  the  different  workcenters  are  ex¬ 
plained  by  the  differences  In  the  variety  of  the  primary 
tasks  that  each  Is  responsible  for. 

3.  Column  3  Is  the  number  of  evaluations  that  were 
conducted  by  QC  under  MSEP  on  the  technicians  In  that  par¬ 
ticular  workcenter. 

4.  Column  4  Is  the  number  of  maintenance  actions 
that  the  evaluations  In  Column  3  represent.  A  specific  eval¬ 
uation  may  have  Involved  only  one  maintenance  task  or  several 
different  ones. 

5.  Column  5  Is  the  pass  rate.  This  figure  repre¬ 
sented  the  percentage  of  tasks  that  QC  rated  technicians  at 
least  qualified  during  the  various  evaluations  conducted. 

6.  Column  6  contains  the  number  of  personnel 
assigned  to  a  particular  workcenter  who  were  subject  to 
evaluation  under  MSEP  during  1978.  They  represented  the 
average  number  of  technicians  for  each  workcenter  that  were 
subject  to  evaluation  during  the  year.  An  average  was  used 
because  personnel  were  continually  being  transferred  in  or 
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out  of  the  workcenter,  separated  from  the  service,  or  other¬ 
wise  removed  from  MSEP  evaluation  throughout  the  year. 

7.  Column  7  contains  the  SACR  66-6  directed  minimum 
evaluation  requirements.  These  represent  the  number  of 
actual  maintenance  actions  that  could  have  been  evaluated 

if  all  the  required  personnel  evaluations  were  conducted  in 
a  workcenter  in  accordance  with  the  MSEP  requirements. 

These  figures  represent  a  range  because  of  the  following 
reasons i  (a)  each  technician  on  a  team  could  have  received 
credit  for  an  evaluation  even  though  the  whole  team  worked 
on  the  same  maintenance  actiom  or  (b)  each  technician  on  a 
team  might  be  evaluated  on  completely  separate  tasks.  This 
can  be  illustrated  by  using  MHT's  SACR  66-6  minimum  require¬ 
ments  as  an  example.  If  all  12  personnel  in  MHT  had  been 
evaluated  on  7  completely  different  maintenance  actions, 
the  total  number  of  maintenance  actions  evaluated  for  MHT 
would  have  been  84.  However,  if  each  member  of  a  4 -man  MHT 
team  was  given  a  task  evaluation  while  the  entire  team  was 
working  on  one  maintenance  action,  the  total  number  of 
maintenance  actions  evaluated  would  have  been  only  one.  The 
total  number  of  maintenance  actions  evaluated  for  the  entire 
MHT  workcenter  could  have  been  as  low  as  21  if  each  member 
of  the  team  was  evaluated  separately  on  the  same  maintenance 
action. 

8.  Column  8  lists  the  calculated  sample  size. 

These  represented  the  sample  sizes  that  should  have  been 
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evaluated  if  maintenance  quality  was  to  be  adequately  veri¬ 
fied,  according  to  the  methodology  developed  in  Chapter  2. 

9.  Column  9  lists  the  acceptance  number.  These 
are  the  number  of  failures  that  would  have  been  allowed  in 
the  sample  size  before  the  entire  lot  was  declared  to  be 
unsatisfactory. 

Results  bv  Workcenter 

Missile  Handling  Teams.  MHT  performed  162  maintenance 
actions  in  1978.  QC  evaluators  conducted  68  evaluations  on 
69  maintenance  actions.  Of  the  69  maintenance  actions  eval¬ 
uated,  failures  occurred  1.2  percent  of  the  time.  There 
were  12  personnel  assigned  to  MHT,  on  the  average,  who  were 
subject  to  evaluation  under  MSEP.  Calculations  for  the  MHT 
workcenter  show  that  a  minimum  sample  size  of  35  different 
maintenance  actions  needed  to  be  taken  on  the  162  completed 
tasks  performed.  SACR  66-6  required  minimum  MSEP  evalua¬ 
tions  would  have  resulted  in  from  21  to  84  actual  mainte¬ 
nance  actions  being  evaluated.  If  QC  had  conducted  evalu¬ 
ations  on  only  21  maintenance  actions,  a  shortfall  of  14 
evaluations  would  have  occurred,  even  though  they  would  have 
been  within  SAC  guidance.  Likewise,  if  QC  had  conducted 
evaluations  individually  on  technicians  on  different  main¬ 
tenance  actions,  an  overage  of  49  evaluations  would  have 
occurred.  GFAFB  evaluators  evaluated  34  more  maintenance 
actions  than  calculations  indicate  they  needed  to. 
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Missile  Maintenance  Teams.  The  data  for  MMT  shows  chat 
2,438  maintenance  actions  were  completed  in  1978.  QC  con¬ 
ducted  313  evaluations  on  428  maintenance  actions.  MMT 
experienced  an  88.8  percent  pass  race  which  indicated  a 
failure  rate  of  11.2  percent.  There  was  an  average  of  45 
personnel  assigned  to  MMT  at  GFAFB,  who  were  subject  to  MSEP 
evaluations.  Calculations  showed  that  a  total  of  230  main¬ 
tenance  actions  should  have  been  evaluated.  SACR  66-6 
minimum  requirements  indicate  that  from  63  to  315  maintenance 
actions  could  have  been  evaluated  as  required  by  MSEP.  A 
shortfall  or  overage  could  have  resulted  from  QC's  evalua¬ 
tion  efforts.  GFAFB  evaluators  actually  evaluated  198  more 
maintenance  actions  than  were  necessary  according  to  calcu¬ 
lations. 

Combat  Targeting  Teams.  The  results  for  CTT  showed  chat 
2,395  maintenance  actions  were  completed  in  1978.  QC  con¬ 
ducted  118  evaluations  on  353  maintenance  actions.  CTT’s 
pass  rate  was  95.5  percent  for  1978  which  indicated  a  fail¬ 
ure  rate,  and  hence  process  average,  of  4.5  percent.  There 
was  an  average  of  18  personnel  subject  to  MSEP  evaluation. 
Calculations  showed  chat  130  maintenance  actions  should 
have  been  evaluated.  SACR  66-6  minimum  evaluation  require¬ 
ments  led  to  a  range  of  63  to  126  maintenance  actions  that 
should  have  been  evaluated.  This  entire  range  was  far 
below  calculated  requirements.  The  evaluators  at  GFAFB 


evaluated  123  more  maintenance  actions  than  what  calcula¬ 
tions  called  for. 


Electro-Mechanical  Teams.  EMT  completed  6,601  tasks  In 
1978.  QC  conducted  232  evaluations  on  259  total  maintenance 
actions.  The  pass  rate  for  EMT  was  89.2  percent  and,  con¬ 
sequently,  a  failure  rate  of  10.8  percent.  There  were  18 
two-man  teams  assigned  to  the  EMT  workcenter,  on  the  average, 
for  a  total  of  36  personnel  subject  to  MSEP  evaluation  in 
1978.  Calculations  showed  that  the  sample  size  for  EMT  com¬ 
pleted  work  should  have  been  a  total  of  295  maintenance 
actions.  The  SACR  66-6  minimum  requirements  indicated  that 
a  range  of  126  to  252  maintenance  actions  could  have  been 
evaluated.  The  calculated  sample  size  fell  within  this 
range  which  indicated  that  a  shortfall  or  overage  of  eval¬ 
uations  could  have  occurred  while  still  allowing  the  base 
to  remain  within  SAC  guidance. 

Periodic  Inspection  Teams.  The  data  for  PIT  showed  that 
3,392  maintenance  actions  were  completed  by  that  workcenter 
in  1978  and  that  QC  conducted  90  evaluations  on  156  of 
those  actions.  PIT  obtained  a  92.2  percent  pass  rate  which 
denoted  a  failure  rate,  and  hence  process  average,  of  7.8 
percent.  There  were  18  personnel  in  the  workcenter,  on  the 
average,  subject  to  evaluation  under  MSEP,  Calculations 
showed  that  255  maintenance  actions  should  have  been  evalu¬ 
ated  out  of  the  3,392  completed  tasks.  SACR  66-6  minimum 
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MSEP  evaluation  requirements  Indicated  that  a  range  of 
from  42  to  126  actual  maintenance  actions  could  have  been 
evaluated.  This  entire  range  fell  below  the  sample  size 
calculated  to  insure  that  adequate  quality  was  maintained. 

Site  Security  Maintenance  Teams.  The  data  for  SSMT  shows 
that  1,636  maintenance  actions  were  completed  by  this  work- 
center  In  1978.  QC  conducted  120  evaluations  on  236  com¬ 
pleted  tasks.  The  pass  rate  for  SSMT  was  86.6  percent  for 
a  failure  rate  and  process  average  of  13.2  percent.  There 
was  an  average  of  21  personnel  in  the  workcenter  who  were 
subject  to  MSEP  evaluation.  Calculations  for  sample  size 
determination  showed  that  195  maintenance  actions  should 
have  been  evaluated  out  of  the  1,636  total.  If  MSEP  eval¬ 
uation  requirements  were  met  a  range  of  from  49  to  147 
actual  maintenance  actions  could  have  been  evaluated. 

This  range  was  below  the  calculated  sample  size.  The  eval¬ 
uators  conducted  41  more  evaluations  on  maintenance  actions 
than  sample  size  calculations  indicated  that  they  should 
have. 

Facilities  Maintenance  Teams.  The  data  for  FMT  shows  that 
a  total  of  3,473  maintenance  actions  were  completed  in  1978. 
QC  conducted  a  total  of  115  evaluations  on  163  maintenance 
actions.  The  pass  rate  for  FMT  was  95  percent  for  a  failure 
rate  and  process  average  of  5  percent.  There  was  an  aver¬ 
age  of  18  personnel  subject  to  MSEP  evaluation  in  1978. 
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The  calculated  sample  size  was  255,  which  means  that  the 
evaluators  had  a  shortfall  of  92  evaluations  in  order  to 
insure  that  quality  maintenance  was  being  accomplished. 

The  range  of  evaluations  that  could  have  occurred  when  QC 
had  followed  SACR  66*6  guidance  was  42  to  126.  QC  exceeded 
the  highest  figure  in  this  range.  The  entire  range,  how¬ 
ever,  was  below  the  calculated  sample  size. 

Summary  of  Analysis  Results 

The  data  showed  that  6  of  the  7  dispatching  work- 
centers  in  the  321  SMW  received  QC  evaluation  in  excess  of 
the  requirements  of  SACR  66-6  MSEP.  Wing  QC  evaluation 
totals  per  workcenter  show  that  in  four  instances  the  cal¬ 
culated  sample  size  was  exceeded  and  for  the  other  three, 
a  shortfall  occurred.  The  shortfall  for  the  PIT  workcenter 
was  the  largest  with  a  total  of  99,  followed  by  a  92  short¬ 
fall  for  FMT.  There  was  a  shortfall  of  36  maintenance 
evaluations  for  the  EMT  workcenter.  In  five  cases,  the  cal¬ 
culated  sample  size  was  larger  than  the  range  of  values 
that  would  have  occurred  had  the  base  complied  strictly 
with  SACR  66-6  requirements.  In  three  of  these  cases,  the 
sample  size  difference  was  noticeable.  The  calculated 
sample  size  was  129  evaluations  higher  than  the  highest 
value  in  the  SACR  66-6  minimum  range  for  FMT.  It  was  also 
129  evaluations  higher  for  the  PIT  workcenter  and  104  higher 
for  the  CTT  workcenter.  The  calculated  sample  size  fell 
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within  the  SACR  66-6  range  for  MHT  and  MKT.  The  conclusions 
are  that  there  are  some  substantial  differences  between  the 
calculated  sample  size  and  the  sample  sizes  that  would  occur 
if  the  guidance  in  SACR  66-6  were  followed.  The  ramifica¬ 
tions  and  implications  of  this  difference  are  covered  in 
Chapter  4.  Pictorial  comparisons  between  calculated  sample 
sizes,  SACR  66-6  requirements,  and  what  was  actually  evalu¬ 
ated  at  GFAFB  are  given  in  Figures  3  through  9.  OC  curves 
for  the  situation  in  each  workcenter  are  provided  in 
Appendix  A. 


SACR  Maximum 


L 

Figure  3 


SACR  Minimum 
Actual  Inspections 
■»  ■»  Calculated  Number 

MHT  Sample  Size  Comparisons 


MMT  Evaluation  Totals 


SACR  Maximum 
SACR  Minimum 


—  Actual  Inspections 
— —  —  Calculated  Number 


Figure  4.  MMT  Sample  Size  Comparisons 


Number  of  Evaluations 


CTT  Evaluation  Totals 


SACR  Maximum 

SACR  Minimum 


—m  ■  i  Actual  Inspections 
«  —  — .  _  Calculated  Number 
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Figure  8.  SSMT  Sample  Size  Comparisons 


CHAPTER  4 


DISCUSSION  AND  CONCLUSIONS 


Overview 

This  chapter  presents  the  discussion  and  conclusions 
of  the  analysis  of  the  Minuteman  ICBM  Maintenance  Standard¬ 
ization  and  Evaluation  Program. 

Discussion  of  Research  Objectives 

Objective  1.  The  first  objective  of  this  research  was  to 
develop  a  procedure  by  which  a  maintenance  sample  size  could 
be  determined  at  the  wing  level  to  control  maintenance  qual¬ 
ity.  Chapter  2  presented  steps  whereby  such  a  sample  size 
for  each  workcenter  could  be  determined  at  the  wing  level. 
The  analysis  in  Chapter  3  proved  that  a  wing  could  determine 
maintenance  sample  sizes  better  than  the  current  method 
directed  by  SACR  66-6.  There  are  two  considerations  that 
would  be  necessary  before  the  procedure  could  be  used. 

First,  a  method  would  have  to  be  developed  to  differentiate 
the  various  maintenance  actions  by  priority.  Management 
would  most  likely  want  to  emphasize  higher  priority  mainte¬ 
nance  actions.  Accordingly,  QC  could  attempt  to  insure  that 
higher  priority  maintenance  actions  were  evaluated  more 
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often  than  lower  priority  actions.  Second,  the  procedure 
would  have  to  be  used  In  conjunction  with  a  forecasting 
methodology.  Maintenance  managers  need  to  know  how  many 
evaluations  would  be  required  next  month  or  next  quarter, 
not  how  many  were  required  last  month  or  last  quarter.  A 
forecasting  method  would  be  necessary  to  determine  how  many 
maintenance  actions  would  be  scheduled  and  how  many  could 
be  expected  to  be  completed.  Quality  Control  could  plan 
their  evaluation  schedule  and  calculate  an  appropriate 
sample  size  based  on  the  forecasted  maintenance  plan. 

Current  methods  for  scheduling  QC  evaluations  do 
not  consider  the  number  of  maintenance  actions  completed 
for  a  given  period  of  time.  SAC  guidance  states  that  a 
specific  number  of  evaluations  is  required  to  insure  tech¬ 
nician  proficiency  regardless  of  the  amount  of  maintenance 
actions  completed  by  the  workcenter.  There  is  no  firm 
guidance  as  to  the  approach  to  use  for  verification  inspec¬ 
tions  (after-the-fact  inspections)  of  work  completed  other 
than  when  deemed  appropriate  by  local  maintenance  managers. 
There  is  a  requirement  for  QC  to  inspect  50  percent  of  the 
LFs  and  LCFs  to  verify  site  condition!  however,  this  is  not 
necessarily  used  as  a  quality  control  mechanism.  A  more 
scientific  method  is  needed  to  insure  chat  an  appropriate 
number  of  maintenance  actions  are  evaluated  for  quality 
assurance.  This  would  lead  to  a  much  more  effective  and 
efficient  use  of  available  QC  resources  (10). 


Ic  is  noc  suggested  that  the  approach  presented  in 
this  research  would  be  a  panacea  for  the  problem  of  quality 
verification  within  Minuteman  maintenance.  It  is  realized 
that  there  are  many  other  factors  that  enter  into  the  con¬ 
cept  of  quality  assurance.  Because  of  the  critical  nature 
of  the  hardware  involved,  more  emphasis  may  be  placed  on 
Insuring  that  maintenance  is  done  correctly  than  might  be 
placed  on  other  types  of  maintenance  throughout  the  Air 
Force.  A  chronic  shortfall  of  replacement  parts,  severe 
weather  conditions  of  northern  tier  missile  bases,  and  the 
distances  many  of  the  LFs  and  LCFs  are  from  the  support 
base,  all  play  an  important  part  in  the  determination  of 
quality  verification  requirements  at  a  missile  wing.  Also, 
many  of  the  maintenance  actions  are  so  critical  and  the 
results  so  adverse  if  a  mistake  is  made,  that  local  manage¬ 
ment  might  want  as  many  experienced  personnel  at  the  appli¬ 
cable  missile  site  as  can  reasonably  be  spared,  regardless 
of  the  proficiency  of  the  maintenance  team.  Because  of 
these  factors,  suggested  sample  sizes  would  probably  not  be 
strictly  adhered  to  (11). 

The  procedure  developed  in  this  thesis  is  a  more 
rigorous  method  for  determining  sample  sizes  than  the  MSEP 
requirements  established  in  SACR  66-6.  Because  of  the  pres¬ 
sure  on  today's  managers  to  make  the  most  out  of  an  austere 
budget  and  the  trend  toward  personnel  cutbacks,  it  is  nec¬ 
essary  for  Minuteman  maintenance  managers  to  thoroughly 
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review  current  procedures  of  quality  verification.  The 
results  presented  In  Chapter  3  substantiated  this  point. 

Objective  2.  The  second  objective  of  this  research  was  to 
ascertain  the  ramifications  of  the  procedure  developed.  In 
terms  of  increasing  maintenance  quality  control  efficiency 
and  effectiveness.  An  analysis  of  the  ramifications  was 
made  using  the  information  for  the  workcenters  presented  in 
Chapter  2.  In  general,  the  ramifications  of  adhering  to  the 
prescribed  procedure  would  lead  to  significant  manhour  sav¬ 
ings  In  some  cases  and  more  effective  quality  verification 
in  others.  The  approach  was  to  compare  the  calculated 
sample  size  with  the  sample  size  used  by  QC  evaluators  at 
GFAFB,  Conclusions  were  based  on  the  results  of  this  com¬ 
parison  i 

1.  Missile  Handling  Teams.  If  GFAFB  QC  evaluators 
had  used  the  methodology  outlined  in  this  research  to  deter¬ 
mine  a  sample  size,  they  would  have  been  able  to  save  a  sig¬ 
nificant  amount  of  evaluator  time.  The  data  from  Table  4 
show  that  69  maintenance  actions  were  evaluated  by  QC  in 
1978  but  the  calculated  sample  size  Indicated  chat  only  35 
maintenance  actions  needed  to  be  evaluated.  Thus,  QC  eval¬ 
uated  34  more  maintenance  actions  chan  were  necessary. 
Referring  to  Appendix  B,  the  average  number  of  hours  spent 
on  the  evaluation  of  one  maintenance  action  was  10  (5).  An 
MHT  QC  evaluation  team  is  generally  composed  of  2  or  3 
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personnel i  so  the  total  number  of  manhours  spent  evaluating 
one  maintenance  action  by  an  evaluation  team  varies  from  20 
to  30  (11).  Since  QC  evaluators  conducted  34  Inspections 
too  many,  680  (34  x  20)  to  1020  (34  x  30)  total  manhours 
could  have  been  channeled  toward  other  endeavors. 

Because  the  primary  tasks  of  MHT  (missile  removal 
and  emplacement)  are  so  critical,  local  managers  would  prob¬ 
ably  be  uncomfortable  with  a  total  maintenance  evaluation 
figure  of  only  34.  Managers  would  probably  want  QC  experts 
present  during  these  maintenance  operations  even  though  an 
evaluation  was  not  planned. 

2.  Missile  Maintenance  Teams.  The  results  for  MMX 
showed  that  QC  conducted  198  more  evaluations  than  the  cal¬ 
culated  figures  Indicated  they  needed.  An  MMT  evaluation 
team  is  composed  of  2  or  3  evaluators.  Referring  to 
Appendix  B,  the  average  number  of  hours  spent  evaluating  1 
MMT  maintenance  action  was  10.  This  meant  that  20  to  30 
manhours  were  spent  in  the  evaluation  of  1  maintenance 
action.  Since  198  evaluations  were  excessive,  3,960  (198  x 
20)  to  5,940  (198  x  30)  total  manhours  could  have  been  used 
in  other  QC  activities.  The  large  number  of  evaluations 
conducted  at  the  test  base  reflected  management's  concern 
over  the  successful  outcome  of  the  highly  critical  primary 
tasks  of  MMT  (warhead  removal  and  replacement,  and  missile 
guidance  set  removal  and  replacement).  Additionally,  the 
high  failure  rate  of  11.3  percent  probably  influenced 
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managers  co  Increase  the  amount  of  QC  evaluations  In  order 
to  Improve  maintenance  quality.  Retraining  of  MMT  techni¬ 
cians  would  also  be  a  consideration. 

3.  Combat  Targeting  Teams.  The  data  for  CTT  showed 
that  QC  conducted  123  more  evaluations  than  were  necessary 
according  to  the  calculated  sample  size.  Since  a  QC  team 
for  this  workcenter  consists  of  1  or  2  evaluators,  the  man¬ 
hour  savings  based  on  the  average  maintenance  action  evalua¬ 
tion  time  in  Appendix  B  would  be  between  1,230  (10  x  123) 
and  2,460  (20  x  123)  manhours. 

4.  Electro-Mechanical  Teams.  The  results  for  EMT 
showed  that  QC  conducted  36  fewer  evaluations  than  the  cal¬ 
culations  indicated  would  be  necessary.  The  conclusions, 
based  on  these  figures,  were  that  not  enough  maintenance  veri¬ 
fication  of  this  workcenter* s  performance  was  conducted. 
Although  QC  was  within  Command  guidance,  they  were  not 
assuring  maintenance  quality  as  effectively  as  the  method 
presented  in  this  thesis. 

5.  Periodic  Inspection  Teams.  Based  on  calcula¬ 
tions,  QC  conducted  about  100  fewer  evaluations  than  required. 
The  conclusion  was  that  maintenance  quality  was  not  being 
verified  at  an  acceptable  level  for  this  workcenter.  It 
should  be  noted  that  base  maintenance  managers  probably  did 
not  feel  pressure  to  exceed  SACR  66-6  requirements  because 
PIT  maintenance  actions  were  generally  low  priority,  routine, 
or  deferred  type  work.  This  research  ignored  priorities  and 


therefore  concluded  the  calculated  requirement  was  much 
higher  than  what  was  accomplished. 

6.  Site  Security  Maintenance  Teams.  The  data  for 
SSMT  showed  that  QC  exceeded  the  calculated  requirement  by 
evaluating  41  more  maintenance  actions  than  necessary.  The 
total  number  of  manhours  required  by  QC  to  conduct  these 
extra  evaluations  total  820  (41  x  20).  This  was  based  on 
an  SSMT  evaluation  team  being  composed  of  2  individuals  and, 
as  indicated  by  Appendix  B,  10  hours  required  to  evaluate  1 
SSMT  maintenance  action.  Because  of  SSMT ' s  13.2  percent 
failure  rate,  the  extra  QC  evaluations  were  considered  nec¬ 
essary  and  additional  training  was  also  a  consideration. 

7.  Facilities  Maintenance  Teams.  The  results  for 
FMT  showed  that  the  calculated  sample  size  was  larger  than 
the  sample  used  by  QC.  While  QC  evaluated  commensurate  with 
SAC  guidance,  not  enough  maintenance  actions  were  evaluated 
to  insure  maintenance  was  being  performed  adequately  by  the 
workcenter,  according  to  calculated  sample  size. 

Conclusions 

The  Maintenance  Standardization  and  Evaluation  Pro¬ 
gram  is  a  very  viable  and  beneficial  program.  The  intent  of 
the  program,  insuring  quality  maintenance  through  enforce¬ 
ment  of  strict  compliance  to  applicable  technical  orders,  is 
satisfactory.  Improvements  can  be  made  to  the  program  to 
make  it  even  more  effective,  however. 
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A  more  scientific  approach  should  be  used  in  deter¬ 
mining  the  evaluation  sample  sizes.  An  approach  should  be 
used  where  sampling  is  based  on  the  amount  of  maintenance 
performed  rather  than  by  performing  a  certain  amount  of 
inspections  annually.  A  forecasting  technique  should  be 
used  to  predict  how  much  maintenance  will  be  conducted  in 
the  next  applicable  time  period  and  then  an  appropriate 
sample  size,  based  on  the  procedure  developed  in  this 
research,  can  be  determined.  QC  could  use  this  sample  size 
to  plan  its  corresponding  evaluation  schedule.  The  evalua¬ 
tions  could  be  after-the-fact  verification  inspections,  spot 
inspections,  or  personnel  proficiency  evaluations.  The 
point  is  that  a  sample  size  can  be  more  scientifically 
determined  and  that  the  number  of  evaluations,  regardless 
of  type,  can  be  planned.  Proficiency  requirements  could 
still  be  met  in  the  process.  The  end  result  would  be  a 
more  effective  and  efficient  use  of  QC  personnel,  and  SAC 
would  be  more  assured  of  receiving  a  quality  product. 

It  could  be  argued  that  there  are  already  enough 
"built-in"  quality  verifiers  in  the  system  and  that  quality 
is  presently  being  verified  effectively  and  efficiently. 
There  are  a  number  of  means  now  that  are  "de  facto"  quality 
verifiers.  One  of  them  is  the  on-going  electronic  inter¬ 
rogation  between  the  LCF  and  LF  mentioned  previously.  It  is 
a  quality  verifier  in  that  after  a  critical  maintenance  task 
has  been  performed  and  the  system  is  brought  back  on  alert. 
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a  maintenance  fault  will  be  indicated  if  something  improper 
had  been  done.  However,  many  faults  that  could  affect 
launch  status  still  would  not  show  up  in  the  LCF  in  the  form 
of  a  Maintenance  Status  Reply  or  fault  indication. 

A  second  "de  facto"  quality  verifier  is  the  mainte¬ 
nance  team  itself.  Each  team  is  required  to  follow  a 
detailed  checklist  when  it  completes  a  maintenance  activity 
and  departs  the  LF  or  LCF.  This  checklist  contains  a  number 
of  critical  items  that  must  be  visually  checked.  If  improper 
maintenance  had  been  done  on  these  items,  the  maintenance 
team  should  catch  the  problem  during  "back  out,"  assuming 
the  "back  out"  was  done  correctly  and  the  problem  accurately 
reported . 

A  third  "de  facto"  quality  verifier  is  a  result  of 
supervisory  field  visits  to  the  missile  sites.  Workcenter 
supervisors  and  other  key  supervisors  and  managers  within 
the  maintenance  complex  are  required  to  periodically  make 
field  visits  to  an  LF  or  LCF  to  keep  current  with  conditions 
in  the  missile  field.  To  the  extent  that  they  are  proficient 
in  the  maintenance  activity  being  conducted  and/or  with  the 
way  the  equipment  should  be,  they  are  a  means  of  quality 
assurance. 

A  fourth  "de  facto"  quality  verifier  is  the  require¬ 
ment  to  verify  the  condition  of  50  percent  of  the  LFs  and 
LCFs  annually  (13i10-8),  While  the  inspectors  are  not  spe¬ 
cifically  looking  at  particular  past  maintenance  actions, 
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discrepancies  and  shoddy  maintenance  should  certainly  be 
noticed  by  this  inspection. 

One  final  "de  facto"  quality  verifier  is  centered 
around  the  quality  evaluation  team  itself.  While  on  the 
missile  site  to  evaluate  a  specific  maintenance  team  or 
maintenance  technician,  it  would  not  be  oblivious  to  other 
maintenance  activity  going  on  or  to  any  glaring  discrepan¬ 
cies  resulting  from  shoddy  maintenance  performed  in  the 
past.  Most  QC  evaluators  are  proficient  enough  in  the  whole 
system  to  notice  problems  associated  with  the  maintenance 
conducted  by  other  types  of  maintenance  teams.  They  are 
thus  well  qualified  to  verify  maintenance  quality. 

The  "de  facto"  maintenance  quality  verifiers,  dis¬ 
cussed  above,  do  assist  the  maintenance  effort.  It  does 
not  matter  how  maintenance  is  verified  for  quality,  only 
that  an  orderly,  scientific  approach  be  adopted  to  determine 
how  much  maintenance  must  be  verified.  One  method  has  been 
proposed  to  fulfill  this  objective.  This  proposeu  method 
is  not  the  only  way  that  an  efficient  and  effective  sample 
size  can  be  determined.  The  sample  size  should  be  deter¬ 
mined  at  the  wing  level,  however.  It  is  only  at  the  wing 
level  that  all  the  factors  that  go  into  maintenance  sched¬ 
uling  can  be  objectively  ascertained  and  a  rational  approach 
to  the  maintenance  process  developed.  Once  that  approach 
has  been  developed,  the  methodology  for  a  realistic  sample 
size  determination  can  be  carried  out. 
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This  thesis  explained  SAC  ICBM  MSEP.  A  statistical 
procedure  was  developed  to  more  effectively  and  efficiently 
use  available  QC  resources.  The  procedure  considered  the 
number  of  maintenance  actions  performed  instead  of  relying 
solely  on  a  number  of  evaluations  per  technician.  The  data 
from  a  sample  base  was  analyzed  and  the  ramifications  of 
using  the  derived  statistical  sample  size  discussed.  It  was 
shown  that  the  methodology  can  result  in  a  more  effective 
and  efficient  use  of  QC  personnel  when  evaluation  samples 
are  determined  at  the  wing  level.  This  approach  would 
enable  SAC  to  better  verify  and  maintain  the  quality  of  its 
missile  maintenance.  This  becomes  more  critical  as  the 


hardware  ages  and  the  concept  of  deterrence  becomes  more 
important.  The  world  has  to  know  that  the  Minuteman  force 
is  ready  to  do  its  job  anytiae.  A  more  effective  and  effi¬ 
cient  maintenance  quality  verification  procedure  can  enhance 
this  desire. 


69 


Operating  Characteristic  Cni-v«>« 

The  Type  A  Operating  Characteristic  (OC)  curves 
depicted  in  Appendix  A  (Figures  10  -  16)  illustrate  the 
probability  of  accepting  maintenance  actions  of  the  Minute- 
man  maintenance  teams  investigated  by  this  thesis.  The 
range  of  percent  defectives  was  depicted  on  the  abscissa 
(x-axis)  and  the  probability  of  accepting  the  lot  was 
depicted  on  the  ordinate  (y-axis).  The  curves  were  trans¬ 
posed  from  Sampling  Inspection  Tables  by  Dodge  and  Romig. 


Table  5 

Symbols  for  OC-Curves 


«  -  .05 

.10 

n  “  Sample  Size 


c  *  Maximum  Acceptable 
Number  of  Defectives 


Probability  of  Acceptance 


APPENDIX  B 

NUMBER  OF  MANHOURS  SPENT  ON  INSPECTION 
BY  QUALITY  CONTROL  PER  SHOP  IN  1978 
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Table  6 


Number  of  Manhours  Spent  on  Inspection 
By  Quality  Control  Per  Shop  in  1978  (5) 


1.  Periodic  Inspection  Teams 


a. 

Initial  Evaluations 

402.96 

b. 

Annual  Evaluations 

345.72 

c. 

Portal  to  Portal  Evaluations 

120.12 

d. 

Special  Inspections 

576.12 

e. 

Number  of  hours  spent  for  evaluation 
of  one  maintenance  action 

10.00 

Missile  Maintenance  Teams 

a. 

Initial  Evaluations 

1151.88 

b. 

Annual  Evaluations 

2083.92 

c. 

Portal  to  Portal  Evaluations 

840.00 

d. 

Special  Inspections 

705.72 

e. 

Number  of  hours  spent  for  evaluation 
of  one  maintenance  action 

10.00 

Combat  Targeting  Teams 

a. 

Initial  Evaluations 

878.64 

b. 

Annual  Evaluations 

307.32 

c. 

Portal  to  Portal  Evaluations 

60.00 

d. 

Special  Inspections 

417.60 

e. 

Number  of  hours  spent  for  evaluation 
of  one  maintenance  action 

10.00 

Missile  Handling  Teams 

a. 

Initial  Evaluations 

360.00 

b. 

Annual  Evaluations 

1036.80 

c. 

Portal  to  Portal  Evaluations 

672.36 

d. 

Special  Inspections 

244.80 

e. 

Number  of  hours  spent  for  evaluation 
of  one  maintenance  action 

10.00 
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Table  6  (Continued) 


5.  Electro-Mechanical  Teams 


a.  Initial  Evaluations  461.42 

b.  Annual  Evaluations  1650.48 

c.  Portal  to  Portal  Evaluations  300.12 

d.  Special  Inspections  288.00 

e.  Number  of  hours  spent  for  evaluation 

of  one  maintenance  action  10.00 


6.  Facilities  Maintenance  Teams 

a.  Initial  Evaluations  720.12 

b.  Annual  Evaluations  249.72 

c.  Portal  to  Portal  Evaluations  444.96 

d.  Special  Inspections  230.40 

e.  Number  of  hours  spent  for  evaluation 

of  one  maintenance  action  10.00 


7.  Site  Security  Maintenance  Teams 

a.  Initial  Evaluations  86.40 

b.  Annual  Evaluations  1219.08 

c.  Portal  to  Portal  Evaluations  360.12 

d.  Special  Inspections  446.40 

e.  Number  of  hours  spent  for  evaluation 

of  one  maintenance  action  10.00 


NOTE i  The  ten  hour  figure  for  number  of  hours  spent  eval¬ 
uating  one  maintenance  action  was  an  average  based 
on  the  following i  (a)  one  hour  to  prepare  for  the 
evaluation!  (b)  two  hours  en  route  to  the  missile 
site;  (c)  three  hours  of  evaluations;  (d)  one  hour 
to  debrief  the  team;  (e)  two  hours  en  route  back  to 
the  base;  and  (f)  one  hour  to  write  up  the  report. 
The  travel  time  was  an  average  based  on  average  dis¬ 
tance  to  the  various  missile  sites  at  GFAFB, 

The  figure  was  for  maintenance  action  verification 
and  not  for  specific  technician  evaluations.  More 
than  one  technician  evaluation  may  have  occurred 
during  the  ten  hour  period  even  though  only  one 
maintenance  action  was  being  accomplished. 
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